MPEG2 moving picture encoding/decoding system

ABSTRACT

An MPEG2 moving picture and encoding/decoding system to provide digital copy protection of digital moving picture data. The MPEG2 moving picture encoder discrete cosine transforms a video input signal and uses a digital watermark inserter to embed digital watermark information on a frequency domain of the discrete cosine transformed video input signal. The MPEG2 moving picture decoder receives the encoded video output signal from the MPEG2 moving picture encoder and removes the embedded visual watermark information to locally decode the encoded video signal.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No.09/136,685 filed Aug. 19, 1998, which claims the benefit of KoreanApplication No. 1997-039481, filed Aug. 20, 1997, in the KoreanIndustrial Property Office, the disclosures of which are incorporatedherein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention can be used for a Moving Picture Experts Group(MPEG) moving picture compression/decompression application of motionprediction/compensation based on a discrete cosine transform andminimizes degradation of image quality.

This invention relates to a digital copy protection application ofmoving picture data which is seldom removed intentionally orunintentionally by a user except an author, and more particularly,relates to an MPEG2 moving picture encoder/decoder.

2. Description of the Related Art

The MPEG2 standard is a compression/decompression standard for videoapplications, and exploits temporal redundancy for motion compensatedinterpolated and predicted encoding. That is, the assumption is madethat “locally” the current picture can be modeled as a translation ofthe picture at a previous and/or future time. “Locally” means that theamplitude and direction of the displacement are not the same everywherein the picture.

The MPEG2 standard specifies predicted and interpolated interframeencoding and spatial domain intraframe encoding. It has block basedmotion compensation for the reduction of temporal redundancy, and ablock based Discrete Cosine Transform based on compression for thereduction of spatial redundancy.

The information relative to motion is based on a 16×16 array of pixelsand is transmitted with the spatial information. Motion information iscompressed with variable length codes, such as Huffman codes.

Recently, audio/video information expressed as digital information isbecoming more widely used and a method utilizing digital products alsohas been increasing accordingly as digitalization of the A/V applicationand popularity of the Internet have been increasing rapidly.

Specifically anybody who is able to use a PC can copy/edit digitalproducts easily and accordingly a social issue of illegal copying hasbeen raised. A watermark technique has become prominent as a solution toprevent this problem.

There are two exemplary methods for providing copy protection of digitalA/V data to prevent illegal copying. The first method is encryption,i.e., a copy protection method by scrambling the digital information.The second method is a digital watermark method with the purpose ofpreventing the illegal use of digital information.

The first method is a technique for prevention of illegal copying ofdigital A/V data, by providing descramble information and passwordinformation capable of accessing and running the A/V product only in thecase that the A/V product is bought legally.

The second method is a technique which utilizes self-restraint by a userto not produce an illegal copy of the A/V product by embedding IDinformation or a logo in a state of noise into A/V contents data of theA/V product for the purpose of forbidding the illegal or commercial useof digital information. The watermark technique is used on the originalimage and is invisible to a person who would copy it, but the author canprove that the copied image is his by virtue of an arbitrary reverseprocessing.

For example, in a case where a counterfeiter forges money using a colorcopier, a vignette on the original bill turns clear by copying the bill,and consequently, it makes it virtually impossible to copy a bank note.This is called a visible watermark.

Also, in the case where a spy writes a message onto paper with saltwater, other people think this is ordinary paper, but this paper is amedium having important information for the spy. The spy can see themessage anytime he wants to see by heating the paper. In this case, wecall it an invisible watermark.

At present, the watermark technique is used for digital still images oraudio, i.e., putting the message distinguishable from the original imageinto the image. Therefore, in case that an author's own image circulatesillegally, the image can be proved to be that of author by performing anarbitrary reverse processing.

Thus, techniques for preventing the illegal copying of digital productare increasingly being studied these days.

FIGS. 1 and 2 illustrate a conventional MPEG2 moving picture encoder anddecoder respectively. FIG. 3 illustrates a structure of a video pictureused in the MPEG2 moving picture encoder/decoder and, FIG. 4 illustratesthree types of pictures and their relationship under the MPEG2 standard.We will explain the conventional MPEG2 moving picture encoder anddecoder by referring to these figures.

MPEG encoding is a hybrid type lossy coding technique wherein theredundancy information which the image signals have in the spatialdomain and the temporal domain are removed and the data are compressed(refer to FIG. 3). At this time, the compression technique of spatialdomain is called intra-coding and the image data used in intra-codingare called intra-picture (in short, I picture). The compressiontechnique of temporal domain is called inter-coding and in this case,the image data are classified by two according to two predictionmethods. The first one is a predicted picture (P picture) whereinprediction error rate of a forward direction is encoded, and the secondone is an interpolated picture or bi-directional picture (B picture)wherein a prediction error rate of the bi-directional direction isencoded.

In other words, the I picture is encoded independently of other nearpictures (in this instance, the picture is a frame signal or a fieldsignal). In the P picture, the difference signals ofpredicted/interpolated movement are encoded only after considering thecorrelation of the movement of the previous I picture or P picture. Inthe B picture, the difference signals of predicted/interpolated movementare coded only after considering the correlation of the movement of theprevious I or P picture and the next I or P picture.

Among the three modes, that is, the forward direction mode, backwarddirection mode, and forward and backward direction mode, the mode havingthe smallest value of prediction error rate is selected in theprediction/interpolation method of the B picture.

The picture structure of the MPEG recommendation (called a main profile,main level; MP@ML) is I, B, B, P, B, B, P . . . pictures and needs aframe memory 110 which can store at least three pictures (the cycle of apicture).

A field/frame adaptive coding method is possible in an MPEG2 encodingmethod so as to increase coding efficiency. The unit of the picture canbe defined as a field or frame according to the purpose of the encoding.A frame/field memory 112 stores the field data or frame data to becoded.

A subtractor 134 receives the field data or frame data from theframe/field memory 112 and interpolated predicted motion data from anadaptive estimator 130, to perform a subtraction of local decoded I or Ppictures, wherein the motion prediction is interpolated to encode theprediction error rate of the P and B pictures, and the pictures whichare now input. A Discrete Cosine Transform (DCT) 114 performs anorthogonal transform which transforms image signals from the subtractor134 spatially structured into image signals of the frequency domain. Aquantizer 116 approximates signals to a typical value to map theDCT-transformed image signals to a code book which is defined in avariable length coder (VLC). Data loss occurs in the quantizer 116.

A dequantizer 122 performs an inverse process of the quantizer 116 forencoding the prediction error rate of P and B pictures. An inverse DCT(IDCT) 124 performs an inverse process of the DCT 114 for encoding theprediction error rate of the P and B pictures. A subtractor 126 performsa subtraction operation on the output from the IDCT 124 and theinterpolated predicted output from the adaptive estimator 130. A framememory 128 stores local decoding images output from the subtractor 126according to the dequantizer 122 and the IDCT 124.

A motion estimator 132 encodes the prediction error rate of the P and Bpictures output from the frame/field memory 112 and the adaptiveestimator 130 is a motion compensator which interpolates predictedmotion, providing its output to the subtractors 126 and 134.

An activity calculator 118 reflects the characteristics of thecomplexity of the input images to the quantizer 116 and a ratecontroller 120 sets up the quantizer 116 so that an overflow/underflowof an output buffer 138 does not happen. A VLC & MUX (variable lengthcoder and multiplexer) 136 entropy encodes and multiplexes the signalsoutput from the rate controller 120, the quantizer 116 and the motionestimator 130. The output buffer 138 provides a buffer for the MPEGcoded bit stream output from the VLC & MUX 136.

FIG. 2 shows the conventional MPEG2 moving picture decoder. A buffer 150stores the coded bit stream. A VLD (variable length decoder) & DEMUX 152performs an inverse process of the VLC & MUX 136 (of FIG. 1) to decodethe MPEG coded bit stream. A dequantizer 154 dequantizes the coded MPEGcoded bit stream output from the VLD & DEMUX 152, and an IDCT 156performs an inverse process of DCT of the output of the dequantizer 154.Adder 160 adds the output of the IDCT 156 with an output of amultiplexer (MUX) 170. A previous picture store 162 is a memory formotion compensation of the P or B picture output from the adder 160. Afuture picture store 164 is a memory for motion compensation of the Ppicture output from the adder 160. An adder 166 performs an addition ofthe outputs of the previous picture store 162 and the future picturestore 164 when the motion prediction of the B picture is bidirectional.A ½ multiplier 168 multiplies the interpolation of average values whenthe motion prediction of the B picture is bidirectional, and the MUX 170multiplexes the outputs of the previous picture store 162, the ½multiplier 168, the future picture storer and a “0” bit.

One picture can be divided into uniformly sized regular square areas andeach area is transformed. Therefore, the image is divided into imageingredients of different frequencies from an average value (DC value) toan image ingredient value of an extremely high frequency. This divisionprocess is called an orthogonal transformation and the orthogonaltransformation is a discrete cosine transform (DCT).

Orthogonal transformations, because they have a frequency domaininterpretation, are filter bank oriented. This means that the purpose ofthe DCT is to reduce the correlation of the image information. Sinceeach DCT-transformed coefficient indicates individual frequencyinformation, the correlation of adjacent coefficients is rare. Thediscrete cosine transform is also localized. That is, an encodingprocess illustrates samples on an 8×8 spatial window which is sufficientto compute 64 transform coefficients or sub-bands.

Another advantage of the discrete cosine transform is that fast encodingand decoding algorithms are available. Additionally, the sub-banddecomposition of the discrete cosine transform is sufficiently wellbehaved to allow effective use of psychovisual criteria.

After the discrete cosine transform, many of the higher frequencycoefficients are zero. These coefficients are organized into a zigzag,as illustrated in FIG. 5, and converted into run-amplitude (run-level)pairs. Each pair indicates the number of zero coefficients. This iscoded in a variable length code.

Discrete cosine transform encoding is carried out in the three stages asillustrated in FIG. 5. The first stage is the computation of thediscrete cosine transform coefficients. The second stage is thequantization of the coefficients. The third stage is the conversion ofthe quantized transformation coefficients into run-amplitude pairs afterreorganization of the data into a zigzag scanning order.

Quantization can be viewed as a shift to the right by several bits.Quantization enables a very high degree of compression, and a highoutput bit rate, and retains high picture quality. Quantization can beadaptive with an I picture having fine quantization to avoid“blockiness” in the reconstructed image. This is important because Ipictures contain energy at all frequencies. By way of contrast, P and Bpictures contain predominately high frequency energy and can be coded ata coarser quantization.

One challenge facing decoder designers is the accommodation of a singledecoder system to a variety of display output formats, while complyingfully with luminance/chrominance relationships and the MPEG2 standard.The displayed output of the decoder chip must conform to ConsultativeCommittee International Radio (CCIR) recommendation 601. This specifiesthe number of luminance and chrominance pixels in a single active line,and also how the chrominance pixels are subsampled relative to theluminance signals.

The format defined as 4:2:2 is supported in most cases in industry. Thisdefines 720 active luminance signals, and 360 color differentiatedsignals, where each line of luminance signals has a corresponding lineof chrominance signals. CCIR recommendation 656 goes on to define thenumber of active lines for National Television System Committee (NTSC)and Phase Alternation by Line (PAL) environments as 480 and 576,respectively. The contents as noted above are disclosed in U.S. Pat. No.5,668,599.

The MPEG2 moving picture encoder 100 performs an encoding method byutilizing the cooperation of an intracoding method on the spatial domainand an intercoding method on the temporal domain. The MPEG2 movingpicture encoder 100 performs the intracoding method on the spatialdomain by compressing the original image into a variable length codingof a Huffman code through the DCT 114 and the quantizer 116 andtransmits the variable length code.

The MPEG2 moving picture encoder 100 performs the intercoding method onthe temporal domain by decompressing the I picture compressed on thespatial domain through the dequantizer 122 and the Inverse DiscreteCosine Transform (IDCT) 124, and predicts by comparing the compressed Ipicture with the image being input at present through the frame memory128 and the adaptation estimator 130, and then encodes a differencesignal with the original signal by compensating motion, i.e.,spatial-shifting the image being input at present as much as thepredicted motion.

In the case that a method predicting motion is forward prediction, wecall it the P picture and in case that a method predicting motioncontains all of forward and backward predictions, we call it the Bpicture. Accordingly, motion prediction and compensation of P and Bimages are affected by the picture accuracy coded as the I picture. So,in the decoding process decoding the encoded image, first, the I picturemust be decoded exactly so that the P and B images, to which thedifference signals are transmitted, can be decoded accurately.

But even through the use of the copy preventing technique by encryptionand scrambling as noted above, it is possible to easily copy data whenduplication and key data are known. And also the watermark technique formoving picture data has some problems which can reduce encodingefficiency by embedding ID information and a logo in the form of noise.

The picture structure of an MPEG2 moving picture encoding method, asillustrated in FIG. 4, includes an intraframe (I picture) reducingspatial redundancy information of image information, a predicted frame(P picture) reducing interrelation between frames through forwardprediction, and an interpolated frame (B picture) reducing betweenframes through bidirection prediction.

Therefore, in the decoding of the image signal, only in the case wherethe decoded previous I picture exists, can the P picture be decodedperfectly through motion compensation, and only in the case where thedecoded I and P pictures are used in B picture prediction in theencoding process, can the B picture be decoded through motion decoding.

Up to now, digital watermark information discrete-cosine-transformed inthe form of noise is embedded into an original image and an I picturecodes this digital watermark information.

And the case of predicting motion of the P and B pictures is performedaccording to encoding locally the I picture. Consequently there is aproblem of an error while estimating motion of the P and B pictures bythe mixed watermark information.

Because the watermark technique for still images, which has started tobe studied recently as noted above, includes watermark data on thespatial domain, the watermark technique is not suitable for an MPEGencoding method compressing data by removing redundancy information inaccordance with using interrelation of data on the spatial domain andthe temporal domain.

That is, in case the image quality of the image that contains thewatermark information deteriorates conspicuously in comparison with theimage quality where the watermark information is not contained, themeaning can be lost because the image can deteriorate even though theoriginal object contains watermark information.

Thus, the image containing the watermark information has to appear verysimilar to the image which does not contain the watermark information.

SUMMARY OF THE INVENTION

The present invention is devised to solve the above-noted problems andcan be used by MPEG moving picture compression/decompressionapplications of motion prediction/compensation based on the discretecosine transform.

Accordingly, it is a first object of the invention to provide a digitalcopy protection apparatus of moving picture data that makes it difficultto get rid of watermark information by a user except an author, inaccordance with minimizing degradation of pixels.

A second object of the present invention provides an MPEG2 movingpicture encoder and a third object of the present invention provides anMPEG2 moving picture decoder.

Also, a fourth object provides an MPEG2 moving picture encoding/decodingsystem with the encoder and the decoder.

Additional objects and advantages of the invention will be set forth inpart in the description which follows and, in part, will be obvious fromthe description, or may be learned by practice of the invention.

According to a first aspect of the present invention to achieve thesecond object, an MPEG2 moving picture encoder includes a frame memory,a frame/field memory, an activity calculator, a rate controller, aDiscrete Cosine Transform (DCT) unit, a quantizer, a dequantizer, anInverse Discrete Cosine Transform (IDCT) unit, an adaptation predictor,a motion predictor, a variable length Coding & Multiplexer VLC & MUX anda buffer, and further includes a digital watermark inserter to generateand discrete-cosine-transform a digital watermark on a frequency domainand is installed between the DCT and the VLC & MUX; and a digitalwatermark remover to remove digital watermark information on a spatialdomain of the DCT embedded for preventing an error while estimatingmotion on a temporal domain for P and B pictures by being installedbetween the dequantizer and the IDCT.

In a second aspect of the present invention to achieve the third object,an MPEG2 moving picture decoder includes a first buffer to receive andsave an encoding bit stream; a variable length decoder and demultiplexer(VLD & DEMUX) to receive the encoding bit stream from the first bufferand to various-length-code, and then output the various-length-coded bitstream; a dequantizer to receive and dequantize the various-length-codedbit stream output from the VLD & DEMUX; a digital watermark remover toremove the digital watermark which has been embedded, to locally decodeby reading watermark information and information from the dequantizer; afirst inverse-discrete cosine-transform IDCT toinverse-discrete-cosine-transform the signal from the digital watermarkremover; a digital watermark inserter to again embed the digitalwatermark removed by the digital watermark remover for performing localdecoding, for the purpose of the decoding output; a second IDCT toinverse-discrete-cosine-transform the information from the digitalwatermark inserter; a second buffer, when the video signal decoded fromthe second IDCT and the motion compensation data are added and then thepicture in which the digital watermark is embedded is replayed, savingtemporarily and outputting it; a multiplexer (MUX); a previous picturestore block in which the first IDCT output and the MUX output are addedand saved temporarily; and a future picture store block in which thefirst IDCT output and the MUX output are added and saved temporarily, totransmit the saved value into the previous picture store block.

It is preferable that the MUX receives the signal from the previouspicture storing block, and receives the signal from the future picturestoring block, and receives the signal 0, and receives the signal whichis generated after the signals from the two blocks are added and ½multiplied (treated).

And according to a third aspect of the present invention to achieve thefourth object, in an MPEG2 moving picture encoding/decoding system,includes an MPEG2 moving picture encoder, to output an encoded bitstream after inputting and encoding a video input signal, the MPEGmoving picture encoder including copy protection means using a watermarkfor MPEG2 moving picture data; and an MPEG2 moving picture decoder, todecode the encoded bit stream from the MPEG2 moving picture encoder tooutput a decoded video signal, the decoder including means for replayingperfectly the image into which the watermark is embedded.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other objects and advantages of the invention will becomeapparent and more readily appreciated from the following description ofthe preferred embodiments, taken in conjunction with the accompanyingdrawings of which:

FIG. 1 shows a conventional MPEG2 moving picture encoder.

FIG. 2 shows a conventional MPEG2 moving picture decoder.

FIG. 3 shows a structure of a video picture used in a conventional MPEG2moving picture encoder/decoder.

FIG. 4 shows three types of pictures and their relationship under theMPEG2 standard, i.e., I pictures, P predicted pictures, and Bbidirectionally predicted pictures.

FIG. 5 shows a sequence wherein discrete cosine transform coefficientsare calculated and mixed and the discrete cosine transform coefficientsare quantized in a zigzag manner.

FIG. 6 shows a block diagram of an MPEG2 moving picture encoderaccording to an embodiment of the present invention.

FIG. 7 shows a block diagram of an MPEG2 moving picture decoderaccording to the embodiment of the present invention.

FIG. 8 shows a block diagram of a Discrete Cosine Transform unit,digital watermark inserter and a quantizer shown in FIG. 6.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

While the invention is susceptible to various modifications andalternative forms, specific embodiments thereof have been shown by wayof example in the drawings and will herein be described in detail. Itshould be understood, however, that it is not intended to limit theinvention to the particular forms disclosed, but on the contrary, theintention is to cover all modifications, equivalents, and alternativesfalling within the spirit and scope of the invention as defined by theappended claims.

FIG. 6 illustrates a block diagram of an MPEG2 moving picture encoder200 according to an embodiment of the present invention and FIG. 7illustrates a block diagram of an MPEG2 moving picture decoder 245according to the embodiment of the present invention

In FIG. 6, the MPEG2 moving picture encoder includes a frame memory 210,a frame/field memory 212, a subtractor 234, a DCT unit 214, a digitalwatermark inserter 240, a quantizer 216, an activity calculator 218, arate controller 220, a dequantizer 222, a digital watermark remover 242,an IDCT 224, an adder 226, a frame memory 228, an adaptive estimator230, a motion estimator 232, a VLC & MUX 236, and a buffer 238. Theframe memory 210, frame/field memory 212, subtractor 234, DCT 214,quantizer 216, activity calculator 218, rate controller 220, dequantizer222, IDCT 224, adder 226, frame memory 228, adaptation estimator 230,motion estimator 232, VLC & MUX 236 and buffer 238 operate in the samefashion as the frame memory 110, frame/field memory 112, DCT 114,quantizer 116, activity calculator 118, rate controller 120, dequantizer122, IDCT 124, adder 126, frame memory 128, adaptation estimator 130,motion estimator 132, VLC & MUX 136 and buffer 138, respectively, shownin FIG. 1 and previously described.

The digital watermark inserter 240 makes digital watermark informationnot removable by a user except an author and is embedded on a frequencydomain 8×8 discrete-cosine-transform of the encoded video signal, inorder to reduce the burden on hardware. That is, the process of thedigital watermark insertion by the digital watermark inserter 240 embedsthe watermark information on the frequency domain, so that a duplicatorcannot edit or remove a digital product illegally and arbitrarily.

Referring to FIG. 6, the digital watermark inserter 240 is locatedbetween the Discrete Cosine Transform (DCT) unit 214 and thevariable-length coder & multiplexer (VLC and a MUX) 236 and is alsolocated between the DCT unit 214 and the quantizer 216. It is preferablethat the digital watermark inserter 240 is located immediately betweenthe DCT 214 and the quantizer 216 for visual effect.

Because basically the MPEG2 standard embodies a frequency domainprocessing on the discrete cosine transform, the digital watermarkinserter 240 of FIG. 6 discrete-cosine-transforms the digital watermarkinformation, and then embeds the digital watermark information. Thewatermark information is processed and embedded by in the digitalwatermark inserter 240 and then is added to an original image. Inparticular, the digital watermark inserter 240 includes a watermarkpattern generator 284 to generate digital watermark information(pattern), and a DCT 282 to discrete-cosine-transform the digitalwatermark information. The digital watermark inserter 240 furtherincludes an adder 280 which adds the discrete-cosine-transformed digitalwatermark information from the DCT 282 to the output of the DCT unit214. The added result from the added 280 is input to the quantizer 216.

Thus, the watermark information embedded on the frequency domain isquantized in the quantizer 216 and is variable-length-coded in the VLC &MUX 236. This is an I picture coding process.

The dequantizer 222 dequantizes the I or P-picture coded data in whichthe watermark information is embedded and a digital watermark remover242 gets rid of the embedded watermark information. An IDCT unit 224reverse-discrete-cosine-transforms the I or P-picture coded data forestimating correctly the motion information. Therefore, the MPEG2 movingpicture encoder 200 prevents an error of a temporal domain coding by thewatermark information. The MPEG2 moving picture encoder 200 compensatesfor the error by estimating an image motion that is being input atpresent from the I or P picture restored like this, and then codes adifference signal.

In this instance, the watermark information is embedded on the spatialdomain in the back of the DCT 214. The digital watermark inserter 240embeds the digital watermark information only on the spatial domain ofthe discrete cosine transform (on the spatial domain of its frame).

The digital watermark remover 242 removes the digital watermarkinformation on the spatial domain of the discrete cosine transform whichwas embedded for preventing the error during the motion estimation onthe temporal domain for P and B pictures by using the embedded digitalwatermark information.

FIG. 7 illustrates the MPEG2 moving picture decoder 245 to correctlydecode an MPEG2 video stream including the digital watermark informationembedded as in the MPEG2 moving picture encoder 200 shown in FIG. 6.

The MPEG2 moving picture decoder 245 includes a first buffer 250, a VLD& DEMUX 252, a dequantizer 254, a digital watermark remover 270, a firstIDCT 256, an adder 260, a previous picture store block 262, futurepicture store block 264, an adder 266, a ½ multiplier 268, a digitalwater mark inserter 272, a second IDCT 274, a second buffer 258, and anadder 276. The buffer 250, VLD & DEMUX 252, dequantizer 254, first IDCT256, second buffer 258, adder 260, previous picture store block 262,future picture store block 264, adder 266, ½ multiplier 268, operate inthe same function as the first buffer 150, VLD & DEMUX 152, dequantizer154, IDCT 156, adder 160, previous picture store block 162, futurepicture store block 164, adder 166, and ½ adder 168, respectively, shownin FIG. 2 and described above. The digital watermark remover 270 removesthe watermark information embedded on the spatial domain of the discretecosine transform while restoring motion of the P and-B-picture.

The MPEG2 moving picture decoder 245 performs operations in the reverseorder of the MPEG2 moving picture encoder 200.

Accordingly in the MPEG2 moving picture decoder 245, the watermarkinformation embedded in the MPEG2 moving picture encoder 200 has to betransmitted.

In the case that an encoded MPEG video stream is transmitted through astorage medium such as a disk, it is possible to perfectly restoremotion, referring to it while decoding by embedding the watermark on alead-in domain which the user cannot access directly.

The digital watermark apparatus according to the present invention forpreventing the illegal copying of MPEG2 moving picture data makes itpossible to prevent degradation of the image quality and efficiencyreduction of encoding by the embedded digital watermark information bydecreasing the error while estimating motion of the P and B pictures byusing the embedded digital watermark information.

In case of decoding locally for compensating motion, once the embeddedwatermark information is removed while encoding the I or P picture, andthe embedded watermark information is decoded locally, then the embeddedwatermark information is used as data for motion compensation whiledecoding the P and B pictures.

And in case of decoding for the decoding output, the MPEG2 movingpicture decoder 245 again embeds the watermark information that had beenremoved once for decoding locally in the image signals, andreverse-discrete-cosine-transforms the image signals to which thewatermark information is embedded, and then adds motion compensationdata thereto.

Conclusively, the image in which the watermark information is embeddedis replayed perfectly. Further, there is an effect of decreasingdegradation of the image quality to a maximum extent by restraining anincrease of encoding information according to the organization of thepresent invention as noted above, and that the watermark information isnot removed easily by a user, except an author.

What is claimed:
 1. An MPEG2 moving picture encoding/decoding systemwhich processes a video input signal of MPEG2 moving picture data,comprising: an MPEG2 moving picture encoder to an encode a video inputsignal, said MPEG2 moving picture encoder comprising copy protectionmeans to embed a watermark into the encoded video signal withoutde-entropy coding the encoded video signal to generate an encoded bitstream; and an MPEG2 moving picture decoder, to decode the encoded bitstream from said moving picture encoder, said decoder comprising meansfor replaying perfectly the MPEG2 moving picture data of the decoded bitstream into which the watermark is embedded.
 2. An MPEG2 moving pictureencoding/decoding system which processes a video input signal of MPEG2moving picture data, comprising: an MPEG2 moving picture encoder,encoding a video input signal, said MPEG2 moving picture encodercomprising copy protection means for embedding a watermark into theencoded video signal, to generate an encoded bit stream; and an MPEG2moving picture decoder, to decode the encoded bit stream from saidmoving picture encoder, said decoder comprising means for replayingperfectly the MPEG2 moving picture data of the decoded bit stream intowhich the watermark is embedded, wherein said copy protection meanscomprises: a Discrete Cosine Transformation (DCT) unit to discretecosine transform the video input signal; a digital watermark inserter toembed the watermark discrete-cosine-transformed by said DCT unit on afrequency domain of the discrete cosine transformed video input signal;and a digital watermark remover to remove the embedded digital watermarkon a spatial domain of the discrete cosine transformed video inputsignal, to prevent an error while predicting motion for a P and a Bpicture on a temporal domain of the discrete cosine transformed videoinput signal.
 3. The MPEG2 moving picture encoding/decoding system asset forth in claim 2, further comprising: a quantizer to quantize thediscrete cosine transformed video input signal including the embeddedwatermark subsequent to said digital watermark inserter embedding thewatermark, wherein said digital watermark inserter is located betweensaid DOT unit and said quantizer.
 4. The MPEG2 moving pictureencoding/decoding system as set forth in claim 2, further comprising: aquantizer to quantize the discrete cosine transformed video input signalincluding the embedded watermark; a dequantizer to dequantize thediscrete cosine transformed video input signal including the embeddedwatermark output; and a variable length coder and multiplexer tovariable length code and multiplex the quantized discrete cosinetransformed video input signal including the embedded watermark, acontrol signal to set up the quantizer to prevent or overflow/underflowand a motion estimation signal to estimate motion of an image of thevideo input signal; wherein said digital watermark inserter is locatedbetween said quantizer and said variable length coder and multiplexer.5. The MPEG2 moving picture encoding/decoding system as set forth inclaim 3 wherein said digital watermark inserter uses 8×8 DOT to insertsaid watermark on the frequency domain.
 6. The MPEG2 moving pictureencoding/decoding system as set forth in claim 2, further comprising anInverse Discrete Cosine Transform (IDCT) to inverse discrete cosinetransform the discrete cosine transformed video input signal with thewatermark removed, wherein said IDCT prevents an error on the temporaldomain.
 7. The MPEG2 moving picture encoding/decoding system as setforth in claim 1, wherein said means of replaying perfectly the MPEG2moving picture data of the decoded bit stream in which the watermark isembedded, comprises a digital watermark remover, to prevent an error ona temporal domain of the discrete cosine transformed video input signal.8. The MPEG2 moving picture encoding/decoding system as set forth inclaim 7, wherein the copy protection means comprises a digital watermarkinserter to embed the watermark in I-picture-codes or P-picture codes ofthe encoded video signal, and I-picture-codes or P-picture-codes theencoded video signal, and then said digital watermark remover removesthe watermark in order to prevent the error of the temporal coding. 9.The MPEG2 moving picture encoding/decoding system as set forth in claim8, wherein said digital watermark remover correctly predicts motioninformation of an image related to the encoded video signal.
 10. TheMPEG2 moving picture encoding/decoding system as set forth in claim 9,wherein the watermark is embedded by the watermark inserter within saidmoving picture encoder I-picture-codes or P-picture-codes, and then saiddigital watermark remover removes the watermark, in order to predictexactly said motion information.
 11. The MPEG2 moving pictureencoding/decoding system as set forth in claim 10, wherein the MPEG2moving picture decoder receives the watermark from a recording medium.12. The MPEG2 moving picture encoding/decoding system as set forth inclaim 11, wherein said recording medium is a disk.
 13. An MPEG2 movingpicture encoding/decoding system which processes a video input signal ofMPEG2 moving picture data, comprising: an MPEG2 moving picture encoder,encoding a video input signal, said MPEG2 moving picture encodercomprising copy protection means for embedding a watermark into theencoded video signal, to generate an encoded bit stream; and an MPEG2moving picture decoder, to decode the encoded bit stream from saidmoving picture encoder, said decoder comprising means for replayingperfectly the MPEG2 moving picture data of the decoded bit stream intowhich the watermark is embedded, wherein said means of replayingperfectly the MPEG2 moving picture data of the decoded bit stream inwhich the watermark is embedded, comprises a digital watermark remover,to prevent an error on a temporal domain of the discrete cosinetransformed video input signal, the copy protection means comprises adigital watermark inserter to embed the watermark in I-picture-codes orP-picture codes of the encoded video signal, and I-picture-codes orP-picture-codes the encoded video signal, and then said digitalwatermark remover removes the watermark, in order to prevent the errorof the temporal domain coding, said digital watermark remover correctlypredicts motion information of an image related to the encoded videosignal, the watermark is embedded by the watermark inserter within saidmoving picture encoder I-picture-codes or P-picture-codes, and then saiddigital watermark remover removes the watermark, in order to predictexactly said motion information, the MPEG2 moving picture decoderreceives the watermark from a recording medium, and said watermark isembedded into a domain which a user cannot access directly and a correctmotion restoration is performed by reference to the digital watermarkwhen embedding and decoding said watermark.
 14. The MPEG2 moving pictureencoding/decoding system as set forth in claim 13, wherein the domain,which the user can not access directly, is a lead-in domain.
 15. TheMPEG2 moving picture encoding/decoding system as set forth in claim 14,wherein said decoder has a function to increase encoding efficiency byusing the embedded watermark.
 16. The MPEG2 moving pictureencoding/decoding system as set forth in claim 15, wherein said decoderfor carrying out the function decreases an error while predicting motionof P and B pictures by using the embedded watermark.
 17. An MPEG2 movingpicture encoding/decoding system which processes a video input signal ofMPEG2 moving picture data, comprising: an MPEG2 moving picture encoder,encoding a video input signal, said MPEG2 moving picture encodercomprising copy protection means for embedding a watermark into theencoded video signal without de-entropy coding the encoded video signalso as to generate an encoded bit stream; and an MPEG2 moving picturedecoder, to decode the encoded bit stream from said moving pictureencoder, said decoder comprising means for replaying perfectly the MPEG2moving picture data of the decoded bit stream into which the watermarkis embedded, wherein said decoder prevents degradation of image qualityby removing the embedded watermark.
 18. The MPEG2 moving pictureencoding/decoding system as set forth in claim 17, wherein said encoderfurther comprises a watermark compensation unit that decreases the errorwhile predicting motion of the P and B pictures by using the embeddedwatermark.
 19. An encoder which compresses a video signal by removingredundancy information in accordance with using an interrelation of dataon a spatial domain and a temporal domain of the video signal,comprising: a digital watermark inserter to generate and embed a digitalwatermark on a frequency domain of the video signal that has not beende-quantized in the encoder; and a variable length coder to variablelength code the video signal including the embedded digital watermark.20. The encoder as claimed in claim 19, further comprising a DiscreteCosine Transform (DCT) unit to discrete-cosine-transform the videosignal, wherein the digital watermark inserterdiscrete-cosine-transforms the digital watermark and embeds thediscrete-cosine-transformed digital watermark on the frequency domain ofthe discrete-cosine-transformed video signal.
 21. An encoder whichcompresses a video signal by removing redundancy information inaccordance with using an interrelation of data on a spatial domain and atemporal domain of the video signal, comprising: a digital watermarkinserter to generate and embed a digital watermark on a frequency domainof the video signal; and a variable length coder to variable length codethe video signal including the embedded digital watermark, furthercomprising a Discrete Cosine Transform (DCT) unit todiscrete-cosine-transform the video signal, wherein the digitalwatermark inserter discrete-cosine-transforms the digital watermark andembeds the discrete-cosine-transformed digital watermark on thefrequency domain of the discrete-cosine-transformed video signal, andfurther comprising: a motion estimator to estimate motion on thetemporal domain for P and B pictures of the video signal; and a digitalwatermark remover to remove the digital watermark on a spatial domain ofthe discrete-cosine-transformed video signal, so as to prevent an errorduring the motion estimation on the temporal domain.
 22. An encoderwhich compresses a video signal by removing redundancy information inaccordance with using an interrelation of data on a spatial domain and atemporal domain of the video signal, comprising: a digital watermarkinserter to generate and embed a digital watermark on a lead-in domainof the video signal which is inaccessible directly by a user; and avariable length coder to variable length code the video signal includingthe embedded digital watermark, wherein the video signal has not beenvariable length coded in the encoder prior to being received by saiddigital watermark inserter.
 23. An MPEG2 moving picture decoder whichprocesses an encoded bitstream of a video signal with an embeddedwatermark, comprising: a decoder to decode the encoded bitstream intothe video signal, said decoder including a watermark remover to removean embedded watermark such that the video signal is without thewatermark; and a watermark inserter to decode and insert the removedwatermark into the decoded video signal.
 24. The MPEG-2 moving picturedecoder of claim 23, wherein the MPEG2 moving picture decoder furtherprevents degradation of image quality by using the embedded watermarkinserted by said watermark inserter.
 25. The MPEG-2 moving picturedecoder of claim 23, wherein said decoder comprises: a variable lengthdecoder and a demultiplexer to variable length decode and demultiplexthe bitstream; a dequantizer to dequantize the variable length decodedand demultiplexed bitstream; a first inverse discrete cosine transformto inverse discrete cosine transform the dequantize the dequantizedbitstream; and a device to receive the inverse discrete cosinetransformed bitstream from said first inverse discrete cosine transformand to reproduce the video signal, wherein the watermark remover removesthe watermark prior to being inverse discrete cosine transformed by saidfirst inverse discrete cosine transform.
 26. The MPEG 2 moving picturedecoder of claim 25, said watermark inserter comprises a second inversediscrete cosine transform to inverse discrete cosine transform theremoved watermark prior to be inserted into the decoded video signal.27. The MPEG-2 moving picture decoder of claim 26, wherein the MPEG2moving picture decoder further prevents degradation of image quality byusing the embedded watermark inserted by said watermark inserter.